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ABSTRACT ' / 

\ ' .The Extension Division Committee of the University of 
Missouri 7 St. Loui^V in addressing itself to evaluating teaching 
effectiveness -1% extension- administered programs , held as central » 
concerns: (1) .that most evaluation systems tend to be subjective; <2) 
that Evaluations of programs and faculty who taucjht in then must.be 
undertaken;' (3) that evaluative information, once accumulated, could 
provide meaningful insf^ht into a faculty^ member's teaching 
effectiveness; and (4) that faculty members' should be able to cho6se . 
how they wanted to be evaluated* The following summarizes the system 
presented here: (1) Each Extension program will be evaluated by Form 
A;' (2) Each faculty member who participated in "the program (for 45 
minuttes or more)- will be evaluated either by a short or \ong form or 
by a *juty of peers; and (3) Follow-up^ evaluations will 'conducted 
to determine the long-range impact, of extensioh programs. Evaluation 
Forms A through^lr are^provided. * (Author/CK) / - 
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Introduction • 

* - * • 1 

• " f % * ' 

Evaluating teaching" effectiveness is both a private and -public matter. 

It is private when viewed by an individual faculty member who uses tfie 

evaluation data as a benchmark to, institute improvement in his or her 

classroom performance. It is public matter when a group of, adult learners 

asks the question: "Has , the time I spent in this continuing education class 

keen worthwhile and productive to me and/or my employe*?* 

* * 1 * 

• 1 
. Evaluation of teaching -effectiveness in the extension classroom is now, 

* * * • 

and always has been, occurring. Adult , leatners , many of whom are employed and 

all of whom bring experience* and often vastly diverse backgrounds inta the 

extension classroom, leave the learning experience .with attitudes ranging. 

.on a continuum from "This was the most worthwhile program I have ever attended" 

to "Wow, was ny time wasted!," The ultimate response, of the learners, exhibited 

*• * * * * * • 

in 'overt behavior, ,is that they are either eager to return, or vow never to • 
return, to the continuing education classroom. 



"'Extension programs", as used in this document refer to special, short-term, / 
non-credit, continuing education programs for adults such as conferences, institutes 
workshops and colloquia. It was not within, the charge o£ the Committee to design 
a system to Evaluate faculty teaching in extension-administered courses for credit. 
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Faculty themselves now evaluate, and have 1 always evaluated, their 

extension classroom performance. Such evaluation ranges from formal measures 

of behavioral change induced in the learners to non-measurement resulting 

.in a personal reaction summed in a generalized .phrase like ft I did well 

today — I feel that I really taught those students." Whoever evaluates 

teaching effectiveness in extension programs bjr whatever method, tme /fact 

is clear: extension programs and faculty who teach, in them are 'always- 

^evaluated— either formally* or informally. 

The plan presented herg'is fofc a* system to evaluate teaching effective- 
* * ■ * * * 

ness in extension programs designed to formalize aqg standardize the evalua- 

tion process. The rationale for evaluation is haded, in part, upot* the-. 

. " I . - ' ■ " ' * * . 

following factors: 

1. ' The extension function of a faculty member is one of the * 



three missions of a state university and land-grant college 
Evaluation is mandated if UMSL is to conduct Viable and 
meaningful extension programs which serve the educational 
needs of Missourians. For example, resident teaching is 
•evaluated; \ Research (and the resulting publications) i&*« 
evaluated. It logically follows that extension programs 

and faculty who teach" them must be evaluated. 

* • . 

2; All levels of education, whether financially supported by 
tax dollars or private dollars, are being held accountable 
fofc performance. . 4 

3. Faculty members, by and large, want to be evaluated, they 
z vant to knoV how well they perform In order to have lnfor- 
nation upon which their teaching behaviors can be altered. 



3 • 



\-\ Faculty, by nature of their profession, continually seek 

*"t, * , . ^ * , 

ways of improving their classroom performance. 

'4. Promotion and tenure committees need data upon which to 

: T . „ • 

base- their recommendation that a faculty member be raised 
to the next academic rank and/or/be granted tenure. Since 

teaching in extension programs is c part of .a faculty 

* * * \ 

member's responsibility at a state university .and land- \, 
.grant college, it is logical that information* related to 
X • this performance be sought by, and be of value to, promo- 

tiori^and tenure ccmitteeg. 

* ■ ■ * 

This rationale addresses ^.tself to "Why evaluate teaching effectiveness 

in extension programs?" When discussing any evaluation—especially of teaching 

effectiveness-Tone must look at the objectiveness of Measurement and the ; 

confounding variables- which affect evaluation. 



t 



Obiectiveness 'of Evaluating Teaching Perf ormance 

' . ■■».*" • 

the evaluation of teaching is subjective, at best, whether that 'evaluation 

•; • • ... 

< '. is done in a college credit classroom with undergraduates or in an extension 

non-credit, continuing education classroom with adult learners. The literature 

dealing with the evaluation of teaching' points out that the variables which 

affect evaluation and includes such factors as class size, content of instruction 

/ • ** 

• why the learner participates , whether the program is at the graduate or- under- 

l ... 

graduate/level, personality of f the instructor, experiential limitations of, the 
learne*,. prio^ course expectations, the learner's background, age, sex, health, 
attitude's and values just to mention a few. 

jlhe evaluate of jjearning, by contrast, if conducted io measure behavioral 



change Induced in the learners I can be objective given, that the evaluation 
is carefully and. systematically undertaken. An ideal procedure is to measure 
the cognitive, affective and psychomotor skills of the learners before they 
enter- the learning process* teach to* behaviorally defined objectives, and then ^ 

measure what has been learned with somewhat detailed. objective tests. The 

■ I ■ • 

* \ 

tefita must be designed meticulously using accepted test construction Methods 

and procedure. Follow-up testing dt some later^time to measure retention 

■* 

of learning complet es^the ideal model. . 

Vhile evaluation of learning can be objective, it is nearly impossible 
to do in an extension program of limited duration. ; Even though this kind of 

evaluation would be the best indicator of teacliin^ef f ectiveness, we are forced 

■» * ■ • 

to settle for the kind of evaluation which is used in the college credit . class- 
room. That is, we -turn to the opinions of learners (or* a jiiry of peers) to 

* 

obtaip an expression of /their feelings as to whether or not a. teacher, was efi^ec- 

* ... * 

ti*jL This kind of evaluation* tends to be subjective, but it must lie understbod 
that even the judgement of a promotion . and .tenure comnittee is based On subjec-.* 
tive. data. That is to say, the expressions of scholars who critique research 
are subjective, the opinions of peers about a colleague' § publication are subjee- 
tive, and the feelings of students about a teacher's effectiveness are subjective. 
And, while an administrator might veil place justifiable reliance on the, advice 

y 

of a promotion and tenure committee,' his ultimate decision rests on subjective 
information. * 4 . ' 



A System for Evaluating Teaching Effectiveness 
in Extension-Administered Programs at UMSL „ 



There are three levels of evaluation which the Committee suggests. The first 



deals withe an overall program evaluation and the second deals with specific 

evaluation of . a faculty member's teaching performance in a program. ,The third, 

• • • • * *■ 

related to evaluation of the overall program arfe of teaching ef f ectiveness,, is 
concerned with a follow-up method of evaluation* 



\ 




Evaluating Extension Programfe, \ ; 

The Comnittee recommends that the Continuing Education Program Evaluation 
Form presented as Appendix A be administered at the conalusion of an extension 

rogram. . ' . " _ . 

The reason for the use of this form is that it is recognized, by evaluating 
a program in iis entirety, proper assessment may be made of the contribution 
of individual faculty members who participated in 'the program. . 

^Operationally, it shall be the responsibility of the extension education 

coordinator .in charge of 'the. program to administer this instrument and , tabulate 
the results, for every program, a„copy of 'the evaluation shall, be transmitted 
to the dean of extension, assistant^dean (or director) in charge of the program, 
and, to each member of the planning committee who helped to plan the program, 
The assistant dean' or director shall transmit a copy of the overall evaluation 
to each faculty member who taught in the program as yell as to the chairman of 
the sponsoring academic department (s) and dean of the appropriate school or 
college. The. director of non-rcredit programs shall maintain a file of all 
program evaluations. < 

It is suggested that the form be used' for a period of one year and then 
be evaluated to* ascertain its effectiveness in improviJ| ,the quality of extension 
programs and teaching effectiveness of faculty. * 



XEValuatinp Teaching Effectiveness * , 

The Committee recommends two jeyels of 'faculty evaluations as well as an 
alternate plan for both of phese evaluations. ^ 

* , Level 1. The Faculty Evaluation Form -presented as Appendix B-l % ' 
is to l^e 4 used when a faculty member teaches in an extension* . t 

** * 

program from three quarters of an 'hour to tWee hours of corttact 

A ) 

* % - time. , . 

* > Level 2 . The^Efrculty Evaluation Form presented as Appendix B-2 

. * is to be used when 'a faculty member teaches in an extensiotf 

« * 
program for tfire«.or more hours of contact time. 

Operationally, both forms are to be tailor-made for each program by 

r * * « f 

4 * 

inserting ther name(s) of the faculty member (s) in the appropriate space and 



then duplicated. Ala peroons, appearing on the program shall be evaluated , 

including ad junct #, f acuity.. While the assistant dean or program director will 

—J ■ 1 . \ % 

be respcfosible to see that the evaluations are completed, the extension coorfli- 

nator. will administer the instruments and transmit the originals to the appro- - • 

priate assistant dean or director who .shall review the evaluations 'and consult A 

individually with each faculty .member. • • « 

In the event that the program will not allow sufficient time for learners 

tko complete the Form B-2 evaluations, the cbndinator will mail the 1 form to a - s 

random sample of registrants. Included with the form shall be a self -addressed % 

envelope with a cover letter of explanation stressing the importance of the 

✓ 'J i 

evaluation and urging the registrant to return the completed f orm. ■ 

/ t — 

The evaluation^ orms are not to-be reproduced by any means 1 in order to ' 

. '( r - 

maintain confidentiality of the information. In! no instance is the information' 
to be shown to anyone other than the faculty member to whom the evaluation -applies 



It Vil3/*e the responsibility of the assistant dean or program director 
to* transmit the -evaluation's t$' tho.de'an of ^ exfpns^ipn along with an optional 



.1* 



cgver l§t€er wfiich contains any' pertinent obseyyrftiprfb about the faculty 
member 9 8 teaching performance. The evaluations will be appropriately filed 
(^X faculty name); included witty the 1 evaluation shall be a brochure or course 
announcement pertaining to the prog^n as well as copy of the overall program 
'evaluation- fepnu A 

The assistant/dean or program director shall have access v to the file 
during^ormal office hours. Under no circumstances shal] information be 

removed from. the files. ; ' 

• * t 

Alternate Evaluation Plan . Should a faculty member desire/ he or she may 
choose not to be * evaluated by the leatners but elect to be evaluated- by* a jury 
of peers. (See Appendix C for the suggested evaluation form.) If he follows- 
this plan, he must submit a list of three colleagues from any 'campus 6i the 
University of Missouri and a> list of three practitioners from outside the 
University community who are in position to judge his teaching ^effectiveness. 
The assistant dean or program directot shall randomly select two people from 
the list- of six and arrange for thfem.to attend *j:he proigram to rate the faculty 

member 9 8 teaching effectiveness. ■ ■ 

■ ■ * 

The evaluation form shall pot be reproduced by any means. in order to • { 

• * . ■ " ■ ! 

maintain its confidential nature. In no instance is the information to be '/ 

shared with anyone other than the faculty member to whom the evaluation applies? 
* . / i 

The foifms will then be forwarded to the dean of extension for filing. 

The assistant dean or program director may wish to include a letter of trans-* % 
mittal covering pertinent information which has a bearing on the jury's evalua- 
tion of the faculty members teaching effectiveness. < The evaluatidns-will be . 



/ « * 



8 



filled by faculty name; Inpluded with the evaluation shall be a course 
' • * - \ . 

announcement or brochure, and'a copy of the overall program evaluation form. 

A faculty member requesting the j^py evaluation is. to let his wishes be 

known &t least thirty-days prior to* the) time he is to appear on the program. 

A stipend of $10 per observation hour shWl be paid to each member qf the 

jury. Should a jury member have to travel utore than fifty miles (round trip). 

to the site of the program, he shall also\be reimbursed for travel (from^UMSL) 

and other necessary expenses as determined by the assistant dean or the 4 * 

program director of* ext4ns£on. / • t , • 



uation * • * 

Approximately six months after a program has been completed/ the assistant 

. ^ \ ' 

dean or program director will 1 conduct a follpw-up evaluation of selected 

extension programs by interviewing, a sample of program participants. This 

'«.-, " | • 

interview w$.ll« be a structured telephone interview following the form which 

is presented as Appendix D. A key element tolbe investigated in this, eve ton 

is behavioral change attributable to participation in the extension-administered 

•' - ' ' ' ' I 

program. \\ 

This follow-up interview will provide additional evaluative data which can . 

• ■ ' • i 

be compared with the" evaluation obtained at the* immediate conclusion of the 
„ program. Such animation will add to the objectivity of the overall evaluation. 
* * The assistant -dean or program director will forward the information to- the 
dean of extension witfi an optional letter of . transmittal. The form will be filed 
in each faculty members file who taught in the program. Should the assistant^ 
dean dfeem it appropriate the information will be shared with the committee which 
planned the program and the faculty who tatjght in it. 



Sunfaary - X 

. The Committee, in addressing it%el£ to evaluating^ teaching effectiveness 
in .extension-administered programs, held a* central concerns: (1) that most 
evaluation systems tend to be subjective; (2) that' evaluations of programs 
and faculty who taught in them must be 'undertaken; (3) that evaluative 
information, once .accumulated, could provide meaningful Inuight into a faculty 

member's teaching effectiveness; and (4) that faculty members should -be able 

r* ■ * v * 

to choosa how they wanted to be evaluated* v 

1 ':• . V 

The following will summarise thV system presented here: . \ 

!• Each ExtensSn progprip will be evaluated by Form A. 
2. Each faculty member who participated in the program 
(for forty-five minutes or more) will be evaluated 

\ • •'■'/•' 
either byt 

* I 1 1 ■ 

a) a ghort form (B-l) or long form (B-2) . . 

b) by a jury of peers (C) 

3 s Follow-up evaluations will be conducted to determine the long- • 
range impact of extension programs (D) ♦ 



UNIVERSITY OF MISSOURI ST. LOUIS 
Extension Division 

„ Continuing Education Program Evaluation Form 



> / 



.DATE:. 



♦..NAME OF PROGRAM:, — ' 

An important part of any educational program is ijs evaluation. Your help in assisting the Extension Division to improve it's programs 
will be of great help in planning similar' programs. We are .net searching for compliments; we need your honest opinion about the 
program you have just complete^/ , 

1 , How would you rate the overall program as an educational experience? e 

□ Excellent QVery Good □ Good □ Fair □ Poor 

2. To what extent did the prbgram content meet your needs and interests? 

□ Very Wfjl □ To some extent □ Very little 



3„- What would ypu have added to the program? 



4. * What would you have deleted from the program? 



5. What benefits (if any) did you reetfve from participating in the program? ■ 



.6. How would you rate the following? 

Excellent 
% „ Facilities □ 
\ Meals < \U 

Helpfulness of .staff □ 



Very Good Good 
□ □ 



v 7, * Please comment critically on any or all of the presentations: 



\ 



Fair Poor 

□ □ i 

□ □ » 

□ □ 



8^ Will your job or personal behavior change as a result of this continuing education — «wrar«T 
□ Definitely □ Probably □ Undecided □ Probably Not • □ Definitely Not 
If yes. HOW? ' ~ 



/ 



9. OTHER COMMENTS: 



July, 1973 



Name:. 
Date:. 



\ 



\ 



(optional) 



UNIVERSITY OF MISSOURI-ST. LOUIS' 
Extension Diviston 
Faculty Evaluation Form s B-1 . 



B-1 



NAME OF PROX3RAM: 



DATE: — 



If you have not had an 
opportunity to observe a 
given faculty member, 
qlease draw a line through 
his or her name. 

faculty Member 




COMMENTS: 



Relevance 
of material 



Nama: 



Date: 



( 



Organization 
of materiaj- 
(logical 
sequence) 



Teaching 
techniques 
(methods 
appropriate 
to material) 



Clarity of 
presenta* 
tion« 



Responsive- 
ness to 
needs and 
interest 
of group 









• * 




% 












/ 


Exc. 




•. □ 


□ 




r ' □ , 


Good 


□ 




□ 


r- 1 


Ul 


Fair 


□ 


□ 


□ 


n 
U 




Poor 




;□ 


□ 


CI 




Exc. 


□ 


•□ 


□ 


□ 


□ 


Good 


□ 


□ 








Fair 




□ • 


□ 


m 
. □ 


n 
LJ 


Poor 


□ 


□ 




□ 


n 
U 


Exc. 


□ 


□ 




□ 




♦pood 




□ 


□ 


□ 


u 


Fair ' 


□ 


□ 


□ 


□ 


4 U 


Poor 


□ m 


D • 


□ 


p 




Ex. 


□ % 


□ 


□ 


. □. 


□ 


6odd 


□ 


□ 


. □ 


□ 


n 

LJ • 


Far 




□ 


□ 


U 


u 


. Poor 


□ 


□ 


□ 


□ 


is 


Exc. 


u 


□ 


□ 


□ . 




Good 


□ ' 


□ 


□ 


n 


U 


Fair 


□ 


4 

□ • 


□ 




n 


Poor 


□ 


□ 


f— i 


( — 1 

u 


n 

LJ 


Exc. 


□ 


□ 


. □ 


□ 




Good 


" □ 


. □ 


□ 


. □ 




' Fair 


□ 


□ 




- □ 


□ 


Poor 


□ 


□ 


u 


\ □ , 


□ 


Exc. - 


□ 


□ 


. ■ □ 


• □ 


a 


Good 


□ 


□ 


□ 


*.□. • 


Us 


Fair 


□ 


□ 


. □ 


□ * 


n 


Poor 


□ 


□ 


□' 


• to 


□ 


Exc. 


□ 


□ 


□ 


□ 


□ 


tiood 


□ 




□ 


■ ' □ 


□ 


Fair 


□ 


□ . 


■ □ 




□ 


Poor 


□ - 




□ ■ 


u 


□ 




Ptease note that the information yeu provide will.be kept confidential. Yotf need not fty ths-evaluation form if you do not wish to 
Nj so. Only summaries of ail of the evaluations «HII be shared with the instructors/ 
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UNIVERSITY OF MISSOURI-ST. LOUIS 
Exten$ian Division 

Faculty* Evaluation FWm B-2 ~ 



B-2 



Name of Instructor Being Evaluated:. 



. Date: 



Name gf Program: J | _ U= : . . ■ — 

^ch of the statements below deals with a characteristic of instructors- which adults f$el to be important. Please rate the Instructor ^ 
whose name appears atJove by placing a check mark {✓) in the box, which best expresses your opinion about him. 
There* are. no "right" ok j'wrong" answers. Just be honest in your rating and express your own feelings. When the information is 
shared witb the instructor, your name will not be-associated with it. You may or may not wish to sign the form. 

r • / * - 



Vr The* instructor was helpful to me. when I had difficulty In understanding^ the 
material he presented '1 . . : - . 

\ ; ' m • - " '• . 

^ 2.^ Y e (or she) m appeared sensitive to my feelings and problems* . 
3. He was f fexible (thangeji his plans to meet my interests and ne^ds) 

9 • " • * 




4. He made roe feel free to ask questions, disagree, ancfexpress my ideas 

» • i i ^. 

i£ His speech w^dequate for teaching . . a . • ■* ■ * * 

7 * - * - " * = 

(6. He was interested in th^su^ect . . . . . ,L 

V7.*" * He us&d illuftrStipns'or examples to clarify' materials 



8. He presented materials in a ifoell«organjzed manner . . . 

" * ' . V . *. . ' ' / ' . ' • ; 

9. The instructor stimulated my thjnking . . . . . 

10. He presented material in an intejestn|g way 

11. His instructional materials (including audio*nWal*^wer.e 
presented. * /.*.-...".... . 



pertipent to the topips . */ 



12^ Hfe made it clear how the topic was related to myneeds 



13. . He seemed well-prepared to teach this class v - 



14. „ Class time was $el 
.15/, Overall, he was on 



dpm or never wastec 
of th$ trat instru( 



r . ' 



wasted* 

instructors I have-ever had 



f lease make additional comments about the imtructofa#hich you feel are important to his te^ing/ffectiveness. 



Faculty member being evaluated :_ 
Name of Extension program: 



Date: 



^ UNIVERSITY^/ MISSOURI-ST. LOUIS 
* Extension Division 

Jury Evaluation Form for Teaching Effectiveness 



_No, of hours observed:. 



Each of the items below deals with a characteristic of instructors which adult learners feel to be important. Rate the faculty mem- 
ber by placing a check rrtark at the appropriate point on the scale. Please add your comments under each question which will clarify 
or explain your rating. ' ' ' / • 



1. Was the faculty member organized? 



. -well 5 
organized 



Use this space for examples or comments. 



i 



disorganized 



2 "Did he {or she)" present material.in a logicaf sequence? 

i _J ' "I I ' I 

•logical / -*\ yl^aL 



3T < 'was the instructor interested in the subject? 

• L : ' — UL_ — LU- 



J ■ 1 

interested 



uninterested 



• . ■ . - j 



4. Did he use illustrations^pr exarrtpjes to clarify key points? 

V i . i" - i 



J. 



none 



^^p-many 



5. Did he take imo consideration the unique experience and backgrounds of 



the* learners* 



1 



J 



very mdch 



little- 



6. Did the inst^uctor^eem to stimulate learners' thinking? 

L 



not at all 



very much 



."^-■i Did I 



Did he dwell upon the.obvious? 

J L. 



)leUpn 
obvious v 



\ 



■ \ . 



i 1 

introduced ■ 



■interesting ideas 



OV€R 



8. JWas the faculty member flexible tfor example, did he change his plans to 
meet the expressed needs of thfe learners)? 



i 

-in- 



flexible 



rigid 



J 



Use this space for examples x or comments. 



9 Were his learning objectives clear to the learners? ^ 
'L— J : I —I 



J 



obvious 



not dear at ?II 



10 Did he appear sensitive to the students' feelings and problems? 

" I L L_ — I 

insens. 7^ ~ I 5 ; very sensitive 



12. 



1 1 . Did he encourage questions, disagreements, discussion? 



L 



1 



very 

encouraging 



Was his speech adequate for teaching? 



L 



inadequate 



i 



intolerant 



very adequate 



j 



13.' Did he present .the rnaterial in an interesting way? 



L 



dull 



1 



J* 



very interesting 



v 

M. 



ERIC 



14., 



'Overall, how would you rate the faculty member on his teaching effectiveness? 



among the 
tpp 10% & 
faculty I* 
have known 



among the least 
effective I 
have known ^ 



Please go back over the list and place 9 check mark {✓) before Name: 

the five items which you consider to be most important in 

evaluating a faculty member's teaching effectiveness. * Title: 

Based on what you have observed in this' program, please , Address: 

make additional comments about the faculty member on a 

separate page and attach to this forn% — 



July. 1973 



Datr,. 



UNIVERSITY OF MISSOURI-ST. LOUIS - ■ . 
"Extension Division 

Follow-up Program Evaluation, Interview JJchedu'e 



Name of Interviewee:. 



Faculty who taught in the program:. 



Hello, my name is . 
and I am calling about the Extension program you attended at. 
If you will recall, the name of the program was. 



I am with the Extension Division of the University of Missouri-St. Louis 



on. 



I ?m helping the Dean evaluate the program and would really appreciate your help. Do you have a few minutes to talk? 
-H Do you remember participating in this program? 



Yes. 



No. 



Z Can you remember what your overall rating of the ^gram was?. 



\#- Would yqu still rate it the same way now? 



Yes. 



.No. 



3. Qn you remember the name of an instructor who did an 

©utstandi ng teaching job? Yes _ 



No. 



4. Who?_ 



, What do you particularly remember about this instruct^? 



Do you recall some things you learned from participating in^he program? 



5. Did yoiirparticipating in the program in any way influence: 
your perebnal life? "Now? * 

*o * \ 

the way you ^> your job? How? 

I I 

your career development? How? 



6. Would you recomrhend that someone else take the program? Yes>_ 
Comments: ' • * 



No. 



\ 



/ • 



/ 



ERIC rrearinchouse 

JUL23.TO 
on Adult' Loucatjpn 



